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@ Three-dimensional computer mouse. 

(57) A three-dimensional mouse system for a com- 
puter's display, or a robot, comprising a pointer, 
movable in space by the user; a transmitter, 
being an integral part of said pointer; at least 
three receivers ; a processing unit, having a 
microprocessor, an input/output communi- 
cation interface and a connecting unit for infor- 
mation and power transfer; and a soft-ware 
means. 

The transmitter and the receivers are connec- 
ted to the microprocessor through the in- 
put/output communication interface. The 
microprocessor is connected through the in- 
put/output communication interface to the con- 
necting unit, attached to the computer. 

When the receivers react to a signal received 
from the transmitter, they transfer indepen- 
dently to the microprocessor their output sig- 
nals, depending correspondingly on the space 
position of the transmitter with reference to the 
receivers ; and the microprocessor computes 
the space position of the transmitter; and the 
output signal of the microprocessor is transfor- 
med into an appropriate form and is then trans- 
ferred to the computer and processed by the 
software means to provide on the computer's 
display or in the robot's action a three- 
dimensional reflection, corresponding to the 
movement of the pointer, in real time, in space. 
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BACKGROUND OF THE INVENTION 

Field of the invention 

The present invention relates to user input device 
for computers, more particularly, to an input device, 
known as a "mouse", providing operation on a display 
in three dimensions or other three-dimensional action 
in space, such as robots' manipulation. 

Description of the prior art 

In the modern computer market a mouse is a 
common input device. Different types of such a device 
are used in workstations of medium scale computers, 
CAD-CAM stations and personal computers. 
The known mouse is used by moving it along a hori- 
zontal surface. The mouse comprises a ball, extend- 
ing from the bottom side of its housing. The ball rolls 
in all directions along the surface according to the 
mouse movement. The mouse housing comprises 
sensors, located near the circumference of the ball 
and perceiving any changes of the ball position. The 
sensors transform signals, related to the changes of 
the ball position, into information, which is further 
transmitted to the computer and thus enables to re- 
flect the mouse movement on the computer display. 
The housing of the mouse usually has on its surface 
several additional functional keys for certain "yes-no" 
operations. Such keys enable performance of few ad- 
ditional functions, such as assigning a dot, choosing 
one of a menu options, start or termination of a com- 
mand, etc. 

The mouse is used in a very large spectrum of 
functions: for selecting an optional program from a 
menu, instead of using the keyboard, or as a tool for 
drawing in CAD-CAM workstations or other systems. 

The main limitation of the present mouse systems 
is a result of their principle construction: the mouse is 
supposed to be movable along a two-dimensional 
surface and cannot work when moving in space, be- 
ing disconnected from the surface, and thus cannot 
provide a three-dimensional drawing on a display. 

An attempt to solve this problem was made in UK 
2234576 A. It describes the user input device, com- 
prising a housing, a ball, mounted in the housing but 
projecting through an aperture in the housing, and de- 
tectors, coupled to the ball so as to generate a control 
signal variable in two dimensions in response to 
movements of a user's hand relative to the housing. 
The device further comprises a further control ele- 
ment, mounted on the housing; and a further detector, 
responsive to movement by the user of the further 
control element so as to generate a further control sig- 
nal variable in a third dimension. The further control 
element comprises a rotatable ring, closely surround- 
ing the aperture and the further detector is responsive 
to rotation of the further control element. The device 



thereby enables a user to generate control signals, 
variable independently in three dimensions while the 
hand remains substantially in a position for operating 
the first mentioned ball. 

5 The disadvantage of the input device described 

above is the artificial manner of its operation. Using 
such a device, the user can only create a three- 
dimensional drawing on a display by first putting on 
the display a two-dimensional drawing, using a ball, 

10 movable by the hand; and then building up a third di- 
mension of the drawing by operating a rotatable ring 
indicating movement in the third dimension. 

OBJECTS AND SUMMARY OF THE INVENTION 

15 

It is the purpose of the present invention to pro- 
vide a computer input device, a mouse, movable in 
space by a users hand and enabling to obtain on a 
computer display a three-dimensional image, corre- 
20 sponding to the user's hand movement in space. 

The other purpose is to apply such a mouse to a robot 
control. 

The three-dimensional mouse.system for a com- 
puter's display, or a robot, herein provided, comprises 

25 a pointer, movable in space by the user; a transmitter, 
being an integral part of said pointer; at least three re- 
ceivers; a processing unit, having a microprocessor, 
an input/output communication interface and a con- 
necting unit for information and power transfer; and a 

30 soft-ware means; and said transmitter and said re- 
ceivers are connected to said microprocessor through 
said input/output communication interface; and said 
microprocessor is connected through said input/out- 
put communication interface to said connecting unit, 

35 attached to said computer; 

so that, when said receivers react to a signal received 
from said transmitter, said receivers through said in- 
put/output communication interface transfer indepen- 
dently to maid microprocessor their output signals, 

40 depending correspondingly on the space position of 
said transmitter with reference to said receivers; and 
said microprocessor computes the space position of 
said transmitter using the output signals received 
from said receivers and said transmitter; and the out- 

45 put signal of said microprocessor, representing the in- 
formation concerning the space position of maid 
transmitter, is transformed into an appropriate form by 
said input/output communication interface and is then 
transferred through said connecting unit to said corn- 
so puten and the information transferred is then proc- 
essed by said software means to provide on said 
computer's display or in said robot's action a three- 
dimensional reflection, corresponding to the move- 
ment of said pointer, in real time, in space. 

55 In the preferred embodiment maid receivers are 

placed around said display, being connected to it, at 
predetermined distances between said receivers; and 
said distances could be calibrated by using a specially 
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designed mode. 

In the preferred embodiment said receivers and 
transmitter are ultra sonic. 

In the preferred embodiment said ultra sonic re- 
ceivers and transmitter work according to a method 
known as "Different Time of Arrival" (DTOA) method. 

tn an alternative embodiment said ultra sonic re- 
ceivers and transmitter work according to a method 
known as a phase shift detection method. 

In the preferred embodiment said pointer is con- 
nected to said processing unit by a communication 
and power cable. 

In another preferred embodiment said pointer is 
connected to said processing unit by means of ultra- 
sonic transmission and receiving means; in such an 
embodiment the minimal number of said receivers is 
four. 

In an alternative embodiment said transmitter 
and receivers are optic devices, emitting and receiv- 
ing light beam signals correspondingly. 

In the preferred embodiment said optic transmit- 
ter is a source of a light beam and each of said optic 
receivers comprises a housing, provided with a slot in 
its frontal wall, facing said transmitter; and said slot is 
provided by a lens; and the opposite wall of said hous- 
ing is provided with a longitudinal unit of charge cou- 
ple device (CCD unit); and said CCD unit is placed 
perpendicularly to said slot in said frontal wall; and 
said CCD unit is connected to said microprocessor's 
input. 

The three-dimensional mouse system for a com- 
puter's display, or a robot, herein provided, comprises 
a pointer, movable in space by the user; an optic 
transmitter, at least three optic receivers; a process- 
ing unit, having a microprocessor, an input/output 
communication interface and a connecting unit for in- 
formation and power transfer; and software means; 
and said receivers are connected to said micropro- 
cessor through said input/output communication in- 
terface; and said microprocessor is connected 
through said input/output communication interface to 
said connecting unit, attached to said computer; 
so that, when said receivers react to an optic signal, 
received from said pointer, said receivers through 
said input/output communication interface indepen- 
dently transfer their output signals depend corre- 
spondingly on the space position of said pointer with 
reference to said receivers; and said microprocessor 
computes the space position of said pointer using said 
output signals of maid receivers; and the output signal 
of said microprocessor, representing the information 
concerning the space position of said pointer, is trans- 
formed into an appropriate form by said input/output 
communication interface and then transferred 
through said connecting unit to said computer; and 
the information transferred through said connecting 
unit is then processed by said software means to pro- 
vide on said computer's display, or in said robot's ac- 



tion, a three-dimensional reflection, corresponding to 
the movement of said pointer, in real time, in space. 

In the preferred embodiment said optic transmit- 
ter is placed on said pointer and provided with a power 

5 supply cable for connecting to said processing unit. 

In an alternative embodiment said optic transmit- 
ter is placed on said pointer; and said pointer is pro- 
vided with batteries to avoid the need of a cable con- 
nection of said pointer to said processing unit. 

10 In an alternative embodiment said optic transmit- 

ter is placed away from said pointer; and said pointer 
has a reflector, reflecting optic beams, received from 
said transmitter; and said receivers are protected 
from receiving optic beams directly from said optic 

15 transmitter. 

In the preferred embodiment said microproces- 
sor is a high speed microprocessor MOTOROLA® 
68HC805C4. 

In the preferred embodiment maid connecting 

20 unit is a standard computer connecting unit RS-232. 

In the preferred embodiment said three- 
dimensional mouse is a low power consumption sys- 
tem, and hence does not require any additional sup- 
porting hardware. 

25 In an alternative embodiment said three- 

dimensional mouse is none low power consumption 
system. 

In the preferred embodiment said three- 
dimensional mouse system comprises more than 
30 three of said receivers to improve the accuracy of 
computation of said pointer's position in space. 

In the preferred embodiment said pointer com- 
prises a plurality of additional functional keys for spe- 
cific use. 

35 In one preferred embodiment said pointer is in 

form of a ring, f ittable onto a finger of the user. 

BRIEF DESCRIPTION OF THE DRAWINGS 

40 Fig.1 illustrates the configuration of the three- 

dimensional mouse system, assembled on a personal 
computer (PC). 

Fig.2 illustrates a block diagram of the three- 
dimensional mouse system. 

45 Fig.3 illustrates the optic receiver's construction 

and the way of computation of the angle between the 
receiver and the transmitter. 

DETAILED DESCRIPTION OF THE PREFERRED 
50 EMBODIMENTS 

In Fig.1 one can see a three-dimensional (3D) 
mouse, comprising three main parts. A pointer 10 is 
a small dimension instrument in which a transmitter 
55 1 1 is located. Receivers 1 2 are placed on a PC display 
17. The distances between the receivers 12 could be 
predetermined. The receivers 1 2 react to the transmit- 
ter's 11 movement in apace, and that movement is 
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provided by the user , operating the pointer 10. The 
pointer 10 is connected to a processing unit 13 with a 
communication and power cable 15. The receivers 12 
are independently connected to the processing unit 
with a communication and power cable 14. The proc- 5 
essing unit 13 is connected to a computer 16 through 
a connector 18. 

The transmitter 11 and the receivers 12 are ultra so- 
nic. All the components of the system are of a low cur- 
rent consumption, hence it is sufficient to supply all 10 
the power needed by the system of a standard RS- 
232 connector of a PC. 

In Fig.2 one can see a block diagram of the 3D 
mouse system, described above. The transmitter 21 
moves in apace in front of the computer. The cable 25 1 5 
connects the communication output and the power in- 
put of the transmitter 21 to correspondent compo- 
nents of the processing unit 23. The three receivers 
22 are connected independently to the processing 
unit 23 through the input/output communication inter- 20 
face 27Awith the communication and power cable 24. 
Communication outputs of the receivers 22 and the 
transmitter 21 are connected to the inputs of a high 
speed microprocessor 26. The output and input of the 
microprocessor 26 is connected to a standard com- 25 
puter connector 28 through an input/output communi- 
cation interface 27B. The processing unit 23 is provid- 
ed with DC-DC transformer 29 for power supply of the 
system. 

Principle of operation in real time. The transmitter 30 
21 is transmitting signals, which are received by the 
three receivers 22. The transmitter 21 and the receiv- 
ers 22 are ultra sonic and work according to the meth- 
od, known as "Different Time of Arrival" (DTOA) meth- 
od. 35 

The microprocessor 26 initiates a signal to the 
transmitter 21 and receives three independent signals 
from the receivers 22. The microprocessor 26 is com- 
puting the time between the moment in which the sig- 
nal is transmitted to the moment it is received by each 40 
of the three receivers. This time is transformed to 
length by computing the multiplication of the time and 
the ultra sound speed. 

The position of the transmitter (pointer) is computed 

by the transformations as follows: 45 

x = ^ + Sil__sd 

2 2D 
Y = O2 + Sj 2 - S3 2 



2D 



Z = 2 _ x 2 - Y 2 

Where: 

X f Y,Z - coordinates of the transmitter in space, 
St - the distance of the transmitter from the re- 
ceiver 1, 

5 2 - -"- from the receiver 2 

5 3 - -"- from the receiver 3, 

Di - the distance between rec.1-rec.2; 
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D 2 - the distance between rec.2-rec.3. 
The results of computation are then transferred in 
real time from the microprocessor 26 to the commu- 
nication interface 27 and then, after the appropriate 
transformation, to the the personal computer through 
the standand connector 28. 

In the processing unit correction of border condition 
of the pointer and filtering of received signals are also 
performed. 

The PC will run an appropriate program, to en- 
able the display of a body/point in the space. 

In Fig.3 the optic receiver is shown. The optic an- 
gle receiver comprises a housing 3 1 in form of a cubic 
box. The front side of the housing 31 is provided with 
a slot 32; and the opposite bottom side is provided 
with a Charged Couple Device (CCD) unit 33, which 
is perpendicular to the slot 32. The slot 32 is provided 
with an optical lens 34. 

A beam from the transmitter T (being the light 
source) passes through the lens 34, placed on top of 
the slot 32 and reaches the CCD unit 33. The CCD 
unit 33 transmits the position of the light spot to the 
processing unit, which calculates the point of maxi- 
mum illumination. Using this data the calculation of 
the angle a is performed by calculating the relation 
between the height of the box H and the position L of 
the maximum light point, related to the center of the 
bottom wall of the housing 31 . 

The angel a is equal to the angel of the transmit- 
ter's position to the certain receiver. The processing 
unit calculates in real time the cross point of the three 
beams, received by the three receivers, and finds the 
position of the transmitter T. 

The transmitter may be located into the pointer 
and be connected to the processing unit by a power 
cable. The second option is to provide the pointer by 
batteries and thus to avoid the need of the cable. The 
third possibility of modification is to separate the 
transmitter from the pointer. In this case the transmit- 
ter is located near the processing unit; and the pointer, 
moving in space, is passive and includes only a re- 
flector. Thus the pointer is wireless and provided with 
means to protect the receivers from reacting to direct 
beams emitted by the transmitter. 

While the present invention has been described 
with the reference to the attached drawings, it should 
be appreciated, that other similar embodiments can 
be suggested for realization of the three-dimensional 
mouse system for a computer's display, or a robot. 



Claims 

1. A three-dimensional mouse system for a comput- 
er's display, or a robot, comprising a pointer, mov- 
able in space by the user; a transmitter, being an 
integral part of said pointer; at least three receiv- 
ers; a processing unit, having a microprocessor, 
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an input/output communication interface and a 
connecting unit for information and power trans- 
fer; and a soft-ware means; and said transmitter 
and said receivers are connected to said micro- 
processor through said input/output communica- 5 
tion interface; and said microprocessor is con- 
nected through said input/output communication 
interface to said connecting unit, attached to said 
computer; 

so that, when said receivers react to a signal re- 10 
ceived from said transmitter, said receivers 
through said input/output communication inter- 
face transfer independently to said microproces- 
sor their output signals, depending correspond- 
ingly on the space position of said transmitter with 15 
reference to said receivers; and said micropro- 
cessor computes the space position of said trans- 
mitter using the output signals received from said 
receivers and said transmitter; and the output sig- 
nal of said microprocessor, representing the in- 20 
formation concerning the space position of said 
transmitter, is transformed into an appropriate 
form by said input/output communication inter- 
face and is then transferred through said con- 
necting unit to said computer; and the information 25 
transferred is then processed by said software 
means to provide on said computer's display or in 
maid robot's action a three-dimensional reflec- 
tion, corresponding to the movement of said poin- 
ter, in real time, in space. 30 

2. The three-dimensional mouse system for a com- 
puter's display, or a robot, as in claim 1, wherein 
said receivers are placed around said display or 
said robot's component, being connected to it, at 35 
predetermined distances between said receivers; 

and said distances could be calibrated by using 
a specially designed mode. 

3. The three-dimensional mouse system for a com- 40 
puter's display, or a robot, as in claim 1 ,2, wherein 

said receivers and transmitter are ultra sonic. 

4. The three-dimensional mouse system for a com- 
puter's display, or a robot, as in claim 1 -3, wherein 45 
said ultra -sonic receivers and transmitter work 
according to a method known as "Different Time 

of Arrival" (DTOA) method. 

5. The three-dimensional mouse system for a com- so 
puter's display, or a robot, as in claim 1 -3, wherein 

said ultra sonic receivers and transmitter work ac- 
cording to a method known as a phase shift de- 
tection method. 

55 

6. The three-dimensional mouse system for a com- 
puter's display, or a robot, as in claim 1, wherein 
said pointer is connected to said processing unit 
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by a communication and power cable. 

7. The three-dimensional mouse system for a com- 
puter's display, or a robot, as in claim 1 ,3, wherein 
said pointer is connected to said processing unit 
by means of ultrasonic transmission and receiv- 
ing means; in such an embodiment the minimal 
number of said receivers is four. 

8. The three-dimensional mouse system for a com- 
puter's display, or a robot, as in claim 1 ,2, wherein 
said transmitter and receivers are optic devices, 
emitting and receiving light beam signals corre- 
spondingly. 

9. The three-dimensional mouse system for a com- 
puter's display, or a robot, as in claim 1,2,8, 
wherein said optic transmitter is a source of a light 
beam and each of said optic receivers comprises 
a housing, provided with a slot in its frontal wall, 
facing said transmitter; and said slot is provided 
by a lens; and the opposite wall of said housing 
is provided with a longitudinal unit of charge cou- 
ple device (CCD unit); and said CCD unit is 
placed perpendicularly to said slot in said frontal 
wall; and said CCD unit is connected to said mi- 
croprocessor's input. 

10. A three-dimensional mouse system fora comput- 
er's display, or a robot, comprising a pointer, mov- 
able in apace by the user; an optic transmitter, at 
least three optic receivers; a processing unit, hav- 
ing a microprocessor, an input/output communi- 
cation interface and a connecting unit for informa- 
tion and power transfer; and software means; and 
said receivers are connected to said micropro- 
cessor through said input/output communication 
interface; and said microprocessor is connected 
through said input/output communication inter- 
face to maid connecting unit, attached to said 
computer; 

so that, when said receivers react to an optic sig- 
nal, received from said pointer, said receivers 
through said input/output communication inter- 
face independently transfer their output signals to 
said microprocessor, said output signals depend 
correspondingly on the space position of said 
pointer with reference to said receivers; and said 
microprocessor computes the apace position of 
said pointer using said output signals of said re- 
ceivers; and the output signal of said micropro- 
cessor, representing the information concerning 
the space position of said pointer, is transformed 
into an appropriate form by said input/output 
communication interface and then transferred 
through said connecting unit to said computer; 
and the information transferred through said con- 
necting unit is then processed by said software 
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means to provide on said computer's display, or 
in said robot's action, a three-dimensional reflec- 
tion, corresponding to the movement of said poin- 
ter, in real time, in space. 

11. The three-dimensional mouse system for a com- 
puter's display, or a robot, as in claim 10, wherein 
said optic transmitter is placed on said pointer 
and provided with a power supply cable for con- 
necting to said processing unit. 

12. The three-dimensional mouse system for a com- 
puter's display, or a robot, as in claim 10, wherein 
said optic transmitter is placed on said pointer; 
and said pointer is provided with batteries to avoid 
the need of a cable connection of said pointer to 
said processing unit. 

13. The three-dimensional mouse system for a com- 
puter's display, or a robot, as in claim 10, wherein 
said optic transmitter is placed away from said 
pointer; and said pointer has a reflector, reflecting 
optic beams, received from said transmitter; and 
said receivers are protected from receiving optic 
beams directly from said optic transmitter. 

14. The three-dimensional mouse system for a com- 
puter's display, or a robot, as in claim 1,10, where- 
in said microprocessor is a high speed micropro- 
cessor MOTORALA® 68HC805C4. 



20. The three-dimensional mouse system for a com- 
puter's display, or a robot, as in claim 1,10, where- 
in said pointer is in form of a ring, f ittable onto a 
finger of the user. 

5 
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15. The three-dimensional mouse system for a com- 
puter's display, or a robot, as in claim 1,10, where- 
in said connecting unit is a standard computer 
connecting unit RS-232. 35 

16. The three-dimensional mouse system for a com- 
puter's display, or a robot, as In claim 1,10, 
wherein said three-dimensional mouse is low 
power consumption system, and hence does not 40 
require any additional supporting hardware. 

17. The three-dimensional mouse system for a com- 
puter's display, or a robot, as in claim 1,10, where- 
in said three-dimensional mouse is none low 45 
power consumption system. 

18. The three-dimensional mouse system for a com- 
puter's display, or a robot, as in claim 1,10, where- 
in said three-dimensional mouse system com- so 
prises more than three of said receivers to im- 
prove the accuracy of computation of said poin- 
ter's position in space. 

19. The three-dimensional mouse system for a com- 55 
puter's display, or a robot, as in claim 1,10, where- 
in said pointer comprises a plurality of additional 
functional keys for specific use. 
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